Auditing of content related events

ABSTRACT

At times, it may be desirable to determine that a client system is, or to determine the number of client systems that are, presenting particular dynamic content when an auditable event occurs in the dynamic content. One manner of making the determination may include accessing presentation time information that indicates the time(s) at which one or more client systems present particular dynamic content and accessing event time information indicating the time(s) at which one or more auditable events occur in the dynamic particular content. Based on the presentation time information and the event time information, it may be possible to determine that a client system is, or to determine the number of client systems that are, presenting particular dynamic content when an auditable event occurs in the dynamic content.

CLAIM OF PRIORITY Cross-Reference to Related Application(s)

This application is a continuation of and claims the benefit of priorityto U.S. patent application Ser. No. 14/720,598, filed on May 22, 2015,which is a continuation of and claims the benefit of priority to U.S.patent application Ser. No. 11/023,631, filed on Dec. 29, 2004, now U.S.Pat. No. 9,047,624, issued on Jun. 2, 2015, which claims priority under35 USC § 119(e) to U.S. Provisional Patent Application No. 60/601,654,filed on Aug. 16, 2004, the entirety of which is hereby incorporated byreference.

TECHNICAL FIELD

This description relates to auditing of content related events.

BACKGROUND

Dynamic content may be delivered and presented to users acrosspacket-based networks, such as the Internet. Dynamic content generallyrefers to content that continuously or nearly continuously changes overtime (i.e., content with a temporal dimension), such as audio and/orvisual content. When sent over a packet-based network, such dynamiccontent may be, for example, downloaded content that is fullytransmitted to a client system before the client system presents thecontent. Alternatively, such dynamic content may be, for example,streaming content such as streaming audio and/or video. Streamingcontent generally refers to content that is sent as a continuous streamand presented as it is received at a client system. Thus, a user of aclient system that is receiving streaming content does not wait untilthe content is fully downloaded before the dynamic content is presented,as is the case for downloaded content. Rather, the client systemreceiving streaming content usually downloads and buffers a portion ofthe dynamic content. The client system then presents the bufferedportion as the rest of the dynamic content is downloading.

Streaming content may be sent from a pre-encoded (or otherwisepre-prepared) file (referred to as “on-demand” streaming) or may bedistributed as part of a live broadcast feed (referred to as “live”streaming). For live streaming, a live broadcast feed is typicallyencoded into a compressed digital signal as the broadcast feed isreceived, for example, by an encoder and the encoded signal istransmitted from a server that is able to do multicast; that is, able tosend the same signal to multiple client systems at the same time. Thebroadcast feed may depict live activity (that is, activity occurring asthe feed is broadcasted) or may depict previously recorded activity.

Different segments of dynamic content may be coupled together to form acollection of dynamic content. In addition, different types of dynamiccontent may be coupled together to form a collection of different typesof dynamic content. The different types of dynamic content may include,for example, programming content and advertising content. Programmingcontent is generally the editorial content that a user desires to havepresented. Advertising content is generally any other content besidesthe editorial content and is typically content that promotes particularservices or goods. Advertising content may be, for example, previews forprogramming content being offered in the future (referred to as“previews”), an indication of the source of programming content(referred to as “branding”), or promotions to buy or otherwise acquirespecific products or services (referred to as “advertisements”).

The different types of dynamic content may be coupled in a collectionsuch that they are presented sequentially or simultaneously. Forexample, advertisements may be presented sequentially with programmingcontent, while branding may be presented simultaneously with programmingcontent by being, for instance, overlaid on the programming content orpresented next to the programming content.

SUMMARY

At times, it may be desirable to determine that a client system is, orto determine the number of client systems that are, presentingparticular dynamic content when an auditable event occurs in the dynamiccontent. For example, an auditable event in particular dynamic contentmay be the occurrence of particular advertising content in the dynamiccontent. One manner of making such a determination is to embed aninstruction or other data in the dynamic content that, for example,causes a client system presenting the particular dynamic content to senda message or other data to an auditing system. The message or other datamay indicate that the auditable event has occurred, is occurring, orwill occur, and may identify the particular auditable event. Forinstance, an instruction in dynamic content may cause a client system tosend a message that indicates the client system is presentingadvertising content and identifies the particular advertising contentbeing presented.

In some situations, however, the dynamic content may not include theembedded instructions. In such situations, one manner of making thedetermination may include accessing presentation time information thatindicates the time(s) at which one or more client systems presentparticular dynamic content and accessing event time informationindicating the time(s) at which one or more auditable events occur inthe dynamic particular content. Based on the presentation timeinformation and the event time information, it may be possible todetermine that a client system is, or to determine the number of clientsystems that are, presenting particular dynamic content when anauditable event occurs in the dynamic content.

For instance, when one or more client systems are presenting dynamiccontent, one or more status messages may be sent to an auditing systemby the client system(s). The status messages may indicate the particulardynamic content being presented. The time(s) at which the client systempresents the dynamic content may be determined based on the statusmessage(s), for example, by accessing time information included in thestatus message(s), or by determining a time or times at which the statusmessage(s) were received, were generated, or were transmitted by theclient system(s). Based on the status messages, the auditing system maydetermine, for example, the number of client systems that are presentingthe particular dynamic content at a particular time.

The auditing system also, for example, may receive one or more auditmessages that identify particular auditable events in the dynamiccontent. The audit messages may be received, for example, from a contentdistribution system. The time or times at which the particular auditableevents occur in the dynamic content may be determined by the auditingsystem based on the audit messages, for example, by accessing timeinformation included in the audit message(s), or by determining a timeor times at which the audit message(s) were received, were generated, orwere transmitted.

For a particular auditable event, the auditing system then maydetermine, for instance, the number of client systems that werepresenting the particular dynamic content when the particular auditableevent occurred in the dynamic content. For example, based on the statusmessages, the auditing system may continuously record the number ofclient systems presenting the particular dynamic content at a giventime. When the auditing system receives an audit message, the auditingsystem may access the number of client systems currently presenting thedynamic content and associate the number of client systems with theparticular auditable event identified by the received audit message.

More generally, in one aspect, presentation time information isaccessed. The presentation time information indicates one or more timesat which a presentation of dynamic content occurs at a client system.Event time information also is accessed. The event time informationindicates a time at which an auditable event occurs in the dynamiccontent. A determination is made, based on the presentation timeinformation and the event time information, that the presentation of thedynamic content occurs at the client system at the time at which theauditable event occurs in the dynamic content.

In another aspect, status messages are received at an auditing systemfrom one or more client systems. The status messages are sent by the oneor more client systems as the one or more client systems present dynamiccontent. The status messages also identify the dynamic content beingpresented by the client system. Based on the status messages, one ormore presentation times at which the one or more client systems presentthe dynamic content is determined. Also, an audit message is received atthe auditing system from a content distribution system. The auditmessage indicates an occurrence of an auditable event in the dynamiccontent. Based on the audit message, an event time at which theauditable event occurs in the dynamic content is determined. Based onthe one or more presentation times and the event time, a number ofclient systems presenting the dynamic content when the auditable eventoccurs in the dynamic content is determined.

Implementations may include one or more of the following features. Forexample, a status message may be received from the client system andinclude presentation information. The presentation time information maybe determined based on the status message. Determining the presentationtime information based on the status message may include determining thepresentation time information based on time information included in thestatus message. Determining the presentation time information based onthe status message may include determining the presentation timeinformation based on a time at which the status message is received fromthe client system.

The status message may be received from the client system prior to,while, or after the client system presents the dynamic content.

An audit message including event information may be received and theevent time information may be determined based on the audit message. Theaudit message may be received from a content distribution system and,particularly, a scheduler. Determining the event time information basedon the audit message may include determining the event time informationbased on time information included in the audit message. Determining theevent time information from the audit message may include determiningthe event time information based on a time at which the audit message isreceived.

Determining, based on the presentation time information and the eventtime information, that the presentation of the dynamic content occurs atthe client system at a time at which the auditable event occurs in thedynamic content may include determining that the client system ispresenting the dynamic content at the time the audit message isreceived.

The presentation time information and the event time information may beaccessed at the client system, an auditing system separate from theclient system and a content distribution system, and/or at the contentdistribution system.

The auditable event may include an occurrence of advertising content inthe dynamic content or an occurrence in the dynamic content of aninstruction to present advertising content in proximity to apresentation of the dynamic content.

The dynamic content may include live streaming content or on-demandstreaming content. Quality of service information may be received fromthe client system and indicate a quality of the presentation of thedynamic content at the client system.

Implementations of the described techniques may include hardware, amethod or process, and computer software on a computer-accessiblemedium.

The details of one or more implementations are set forth in theaccompanying drawings and the description below. Other features will beapparent from the description and drawings, and from the claims.

DESCRIPTION OF DRAWINGS

FIG. 1 is a block diagram of a system that provides auditing ofauditable events related to dynamic content.

FIG. 2 is a diagram illustrating a stream of dynamic content.

FIG. 3 is a block diagram of an alternate system that provides auditingof auditable events related to dynamic content.

FIG. 4 is a flow chart generally illustrating a process that may beperformed by the system of FIG. 3.

FIG. 5 is a diagram illustrating a live streaming implementation of thesystem shown in FIG. 3.

FIG. 6 is a diagram illustrating an example of communications betweenthe components of the implementation shown in FIG. 5.

FIGS. 7A and 7B illustrate tables that may be used in the implementationshown in FIG. 5.

FIG. 8 is a diagram showing an on-demand implementation of the systemshown in FIG. 3.

FIG. 9 is a diagram illustrating an example of communications betweenthe components of the implementation of FIG. 8.

DETAILED DESCRIPTION

Referring to FIG. 1, a system 100 includes one or more client systems102 connected to a content distribution system 104 by one or moredistribution connections 106. System 100 also includes an auditingsystem 108 connected to client systems 102 over one or more statusconnections 110.

Client systems 102, content distribution system 104, and auditing system108 may be implemented using, for example, one or more of ageneral-purpose computer capable of responding to and executinginstructions in a defined manner, a personal computer, a special-purposecomputer, a workstation, a server, a device, a component, or otherequipment or some combination thereof capable of responding to andexecuting instructions. These components may receive instructions from,for example, a software application, a program, a piece of code, adevice, a computer, a computer system, or a combination thereof, whichindependently or collectively direct operations, as described herein.The instructions may be embodied permanently or temporarily in any typeof machine, component, equipment, storage medium, or propagated signal.Furthermore, when one or more components are used to implement clientsystem 102, content distribution system 104, or auditing system 108, thecomponents may communicate with one another across packet-based ornon-packet-based networks to implement the respective functions ofclient system 102, content distribution system 104, or auditing system108.

Client systems 102 may execute a hypertext transfer protocol (HTTP)based web browser that presents media pages, such as hypertext markuplanguage (HTML) or other markup language web pages. A media clientapplication may be embedded in one or more of the web pages presented bythe web browser. The media client application presents dynamic content,such as audio content or video content, to a user through, for example,visual, auditory, or tactile presentation devices. The media clientapplication also may implement the HTTP protocol to request the dynamiccontent.

Alternatively, the media client application may be a stand-aloneapplication that presents both static content, such as the staticportion (for example, text or pictures) of web pages, and the dynamiccontent such as audio or video content. A stand-alone media clientapplication also may implement HTTP to request the static content and/orthe dynamic content. Examples of a media client application includeWindows Media Player from Microsoft Corp. of Redmond, Wash. andRealPlayer from RealNetworks of Seattle, Wash., both of which can bestand-alone or embedded into a web page.

Content distribution system 104 may include a content server or otherserver that executes HTTP server software to respond to data requestsfrom an HTTP-based web browser and/or an HTTP-based media clientapplication executing at client system 102. In response to a datarequest for a webpage received from the web browser or media clientapplication, the content server provides a media page, for example a webpage, for presentation by the web browser or media client application.

The web page may present one or more selections of dynamic content,including live streaming or on-demand content. When a user selectsdynamic content, the media client application may download and presentthe selected dynamic content.

Distribution connection 106, status connection 110, and auditable eventconnection 112 may be implemented using packet-based or non-packet-basedcommunications networks such as Wide Area Networks (WANs), Local AreaNetworks (LANs), analog or digital wired and wireless telephone networks(for example, a Public Switched Telephone Network (PSTN), an IntegratedServices Digital Network (ISDN), or a Digital Subscriber Line (xDSL)),or another wired or wireless network including, for example, a corporateLAN. Distribution connection 106, status connection 110, and auditableevent connection 112 may include multiple networks or sub-networks, eachof which may include, for example, packet-based or non-packet-basedcommunications networks.

Client systems 102 may receive and present dynamic content from acontent distribution system 104 over one or more distributionconnections 106. The dynamic content received by client system 102 mayinclude a collection of dynamic content. The collection may includedifferent types of dynamic content, such as programming content andadvertising content. The dynamic content may be stored and provided asone or more segments of dynamic content. For instance, advertisingcontent may be provided as one segment requested by client system 102,while programming content is provided as another segment requested byclient system 102. Furthermore, the dynamic content may be received asstreaming content, and may be live streaming content or on-demandstreaming content.

The dynamic content also may include data that may or may not bepresented by the media client application. The data may be processed asthe media client application processes the dynamic content forpresentation. The data may include, for example, information indicatingthe location of different segments of dynamic content in a collection ofdynamic content (for example, uniform resource locators (URLs) mayindicate different segments of dynamic content to be presented as acollection). As another example, the data may include instructions thatcause the media client application or web page to display other staticor dynamic content in proximity to the original dynamic content.

The dynamic content may contain auditable events. Such an auditableevent may be an event that occurs in the dynamic content for which it isdesirable to determine the number of client systems presenting thedynamic content at the time the event occurs. For example, when thedynamic content is a collection of different types of dynamic content,the event may be the occurrence of one type of dynamic content in thecollection, such as advertising content. Determining the number ofclient systems presenting the dynamic content when advertising contentoccurs may be performed so that advertisers can be appropriately billedbased on how many people viewed the advertising content, assumingsomeone is watching the advertising content when a client systempresents it.

As another example of an auditable event, there may be staticadvertisements, such as banner ads, displayed next to a presentation ofthe dynamic content. Which banner ad is shown and at what time maydepend on the dynamic content being presented and may be selected basedon data included in the dynamic content. The event may be instructionsin the dynamic content to display a particular banner ad. It may bedesirable to know the number of client systems 102 that were presentingthe dynamic content at a particular time so as to know how many clientsystems 102 presumably processed the instruction, resulting in thecorresponding banner ad being presented.

Referring to FIG. 2, auditing tags 202 a and 202 b may be embedded in acollection 200 of dynamic content, for example, to determine the numberof client systems presenting the dynamic content when a certain type ofdynamic content is presented. The collection 200 shown includesprogramming content 204 a and 204 b and advertising content 206.Auditing tag 202 a is embedded after programming content 204 a butbefore advertising content 206. Auditing tag 202 b is embedded afteradvertising content 206, but before programming content 204 b. Auditingtags 202 a and 202 b cause client systems 102 to send a message toauditing system 108 via status connection 110 indicating, respectively,that client system 102 has started presenting advertising content 206and finished presenting advertising content 206.

Accordingly, client system 102 receives and presents programming content204 a. Once programming content 204 a is completed, client system 102processes auditing tag 202 a, which causes client system 102 to send amessage to auditing system 108. The message indicates that client system102 is beginning the presentation of advertising content 206 andincludes an identification of advertising content 206. After presentingadvertising content 206, client system processes auditing tag 202 b,which causes client system 102 to send a message to auditing system 108that indicates client system 102 has completed the presentation ofadvertising content 206. Client system 102 then presents programmingcontent 204 b. Based on the messages auditing system 108 receives fromone or more client systems 102 as a result of auditing tags 202 a and202 b, auditing system can determine the number of client systems 102that presented advertising content 206.

In certain situations, however, auditing tags such as those shown inFIG. 2 may not be embedded in dynamic content. For example, when thedynamic content is a live stream, the equipment or entity encoding thedynamic content may be unable or unwilling to appropriately embedauditing tags into the encoded stream. In other instances, even thoughthe auditing tags are embedded in the dynamic content, a client systemmay not be able to process the auditing tags appropriately. Accordingly,even though some client systems may appropriately indicate that thedynamic content was presented when the auditable event occurred, othersmay not, resulting in an inaccurate audit of the auditable event.

Referring to FIG. 3, a system 300 is similar to system 100, including aclient system 302, communicating with (i) a content distribution system304 over a distribution connection 306 and (ii) an auditing system 308over a status connection 310. Elements 302, 304, 306, 308, and 310 areanalogous to elements 102, 104, 106, 108, and 110, respectively, ofFIG. 1. System 300 includes additional aspects that include auditingsystem 308 receiving audit messages from content distribution system 304over an auditable event connection 312 and client system 302 sendingperiodic or aperiodic status messages over status connection 310. Theaudit messages may indicate the time at which an auditable event occurs.The status messages may identify the dynamic content presented by theclient system, and in some implementations, may indicate a time at whichthe dynamic content was presented, or may indicate for how long thedynamic content was presented. Auditing system 308 then may use thestatus messages and the audit messages to determine a number of clientsystems 302 presenting the dynamic content at the time when theauditable event occurred.

Referring to FIG. 4, an auditing process 400 may be performed by system300. Process 400 includes content distribution system 304 transmittingdynamic content to one or more client systems 302 (402). The dynamiccontent may be streaming content or may be, for example, completelydownloaded to client system 302 before being presented. The dynamiccontent may be, for example, live or on-demand content. As suggestedearlier, the dynamic content may be a collection of dynamic content.

Process 400 further includes content distribution system 304transmitting to auditing system 308 one or more audit messages thatinclude event information that indicates an auditable event hasoccurred, is occurring, or will occur in the dynamic content andidentifies the corresponding auditable event (404). The eventinformation may include one or more times at which an auditable eventoccurs in the dynamic content. The time may be relative to the beginningor other point in the dynamic content (for example, one hour afterbeginning) or may be absolute (for example, 3:00 pm EST). For example,in a live streaming implementation, absolute time may be used becauseclient systems 302 may receive the same feed at approximately the sametime. Thus, the auditable event is likely to occur on client systems 302at approximately the same absolute time.

In an on-demand streaming implementation, however, relative time may beused because client systems 302 are unlikely to receive the dynamiccontent at approximately the same time. Thus, the absolute time anauditable event occurs for one client system 302 is likely to bedifferent from the absolute time the same auditable event occurs foranother client system 302. But, the auditable events may occur at thesame relative time, for example, a set time after the beginning or otherpoint in the dynamic content.

Content distribution system 304 may transmit an audit messagesubstantially simultaneously with the occurrence of the auditable event.For instance, in a live streaming implementation, content distributionsystem 304 may send an audit message at or about the absolute time anauditable event occurs in the live stream. The event information in anaudit message sent substantially simultaneously with the occurrence ofthe auditable event may not include time information. Rather, the timethe auditable event occurs may be determined based on the time at whichthe audit message was received, generated, or transmitted.

Content distribution system 304 also may send one or more audit messagesafter the auditable event(s) occur. For example, in a live streamingimplementation, the times at which auditable events occur may berecorded and then sent to auditing system in one or more batches sentperiodically or aperiodically during the live stream, or may be sent inone or more batches after the live stream has been completed.

Content distribution system 304 also may send one or more audit messagesbefore the event occurs. For example, in an on-demand streamingimplementation, content distribution system 304 may transmit one or moreaudit messages indicating one or more relative times at which anauditable event occurs in particular dynamic content. The one or moreaudit messages may be sent prior to client system 302 presenting thedynamic content, or while client system 302 presents the dynamiccontent, but prior to the occurrence of the one or more auditableevents.

Process 400 includes one or more client systems 302 periodically oraperiodically transmitting one or more status messages to auditingsystem 308 (406). Generally, the status messages allow auditing system308 to determine whether a particular client system 302 is presentingthe dynamic content at a particular absolute or relative time. Statusmessages generally include presentation information that indicatesinformation about the dynamic content presented, such as anidentification of the dynamic content presented. Presentationinformation also may identify a particular state regarding thepresentation of the identified dynamic content. For example, the statusmessages may indicate the beginning of presentation, continuingpresentation, or the end of presentation.

To determine the absolute or relative time(s) at which client system 302was presenting the dynamic content, the time that status message(s) arereceived may be recorded by auditing system 308. Assuming negligibletransmission time from client system 302 to auditing system 308, therecorded times provide the absolute time (assuming any appropriateconversion, such as to a different time zone), and the relative time canbe calculated from the recorded times.

In some implementations, the status messages may include the absolute orrelative times at which client system 302 presents the dynamic content.For example, a status message may include a time stamp of the absolutetime at which it was generated. As another example, a status message mayinclude the amount of time that has elapsed since the presentation ofthe dynamic content started.

Status messages may include an identifier that uniquely identifies theclient system sending the status message. For example, a globally uniqueidentifier may be generated and included in the status messages. Such aunique identifier may allow the auditing system to determine the numberof unique client systems presenting the dynamic content at a particulartime if, for instance, client systems can present more than onepresentation of the dynamic content at the same time and status messagesare sent for each presentation.

Status messages also may include quality of service information thatindicates the quality of the presentation of dynamic content at theclient system. The quality of service information may be based, forexample, on packet loss (for example, the number of packets lost whiletransmitting streaming content to the client system), number of droppedframes in a video presentation, and whether the codec used to presentthe dynamic content is re-started, and if so, how many times.

One or more status messages may be sent while client system 302 presentsthe dynamic content. For example, when the content is streaming contentor downloaded content and client system 302 is able to communicate withauditing system 308, client system 302 may send status messages as thecontent is presented.

On the other hand, one or more status messages may be sent after clientsystem 302 has completed presenting the dynamic content. For example, inan implementation in which the content is downloaded content, clientsystem 302 may be a portable device that may or may not be able tocommunicate with auditing system 308 as client system 302 presents thecontent. Similarly, even if client system 302 is not a portable device,client system may not be able to communicate with auditing system 308.In such a situation, one or more status messages may be generated whenthe content is presented, but stored until client system 302 is able tocommunicate with auditing system 308. When client system 302 is able tocommunicate with auditing system 308, client system 302 then may sendthe one or more stored status messages.

In the event that it is known beforehand the times at which dynamiccontent will be presented, or the amount of the dynamic content thatwill be presented, then one or more status messages may be sent beforeclient system 302 presents the dynamic content.

Continuing with process 400, auditing system 308 then performs an auditof the auditable event(s) related to the dynamic content using thestatus and audit messages (408). To do so, for instance, auditing system308 may access presentation time information determined based, at leastin part, on the presentation information included in the statusmessages. The presentation time information, for example, indicates oneor more times at which a presentation of the particular dynamic contentidentified in the presentation information occurs on one or more clientsystems. The auditing system also may access event time informationdetermined based, at least in part, on the event information included inthe audit messages. The event time information, for example, indicates atime at which the particular auditable event identified in the eventinformation occurs in the dynamic content. The audit may then beperformed based on the presentation time information and the event timeinformation.

The audit may include determining the number of unique client systems302 that were presenting the dynamic content at the time(s) auditableevent(s) occurred by counting the number of unique status messagescorresponding to the time(s) the auditable event(s) occurred. If clientsystems 302 can present more than one presentation of the dynamiccontent at the same time and status messages are sent for eachpresentation, then the total number of presentations of the dynamiccontent by client systems 302 may be determined by counting the totalstatus messages corresponding to the time(s) the auditable event(s)occurred. The audit may include other subsets of the number of clientsystems 302 presenting the dynamic content at the time(s) auditableevent(s) occurred. For example, some percentage of the number of clientsystems 302 presenting the dynamic content may be determined.

Referring to FIG. 5, a system 500 illustrates one particular livestreaming implementation that includes multiple client systems 502 a-502c connected to a content distribution system 504 through a distributionconnection 506. Each of client systems 502 a-502 c is connected to anauditing and advertising system 508 through respective statusconnections 510 a-510 c. Auditing and advertising system 508 isconnected to content distribution system 504 through an auditable eventconnection 512. Client systems 502 a-502 c, content distribution system504, distribution connection 506, auditing and advertising system 508,status connections 510 a-510 c, and auditable event connection 512 areanalogous to client system 302, content distribution system 304,distribution connection 306, auditing and advertising system 308, statusconnection 310, and auditable event connection 312, respectively.

Content distribution system 504 includes a source of programming content504 a, such as the television camera that is illustrated. Source 504 ais connected to a spot replacement server 504 b, which switches betweensource 504 a and a source of advertising content under the control of ascheduler, such as media control center console 504 c. Spot replacementserver 504 b is also connected to auditing and advertising system 508through auditable event connection 512. Also connected to spotreplacement server 504 b is an uplink 504 d. Uplink 504 d is connectedto downlink 504 f through a satellite connection 504 e. Downlink 504 fis connected to one or more encoders 504 g, which are connected to oneor more content servers 504 h. Content server(s) 504 h are connected tothe one or more client systems 502 a-502 c through one or moredistribution connections 506.

Referring to FIG. 6, a process 600 illustrates one implementation ofsystem 500 in which the auditable event(s) are the occurrence ofadvertising content in the live stream. In general, spot replacementserver 504 b provides a broadcast feed to encoder 504 g through uplink504 d, satellite connection 504 e, and downlink 504 f. During certainportions of the broadcast feed, spot replacement server 504 b providesprogramming content to encoder 504 g (602). Encoder 504 g encodes thebroadcast into an appropriate digital format (604) and makes this streamavailable to one or more content servers 504 h (606). Content servers504 h support multicast capabilities so that the stream may be deliveredto multiple client systems 502 a-502 c.

Generally, one or more client systems 502 a-502 c communicate withcontent server 504 h to obtain a media page, from which a user canselect a live stream, such as the one sent from spot replacement server504 b, for presentation by a client system 502 a-502 c. Morespecifically, a web browser or media client application executing on aparticular client system 502 a-502 c may request a media page fromcontent server 504 h (608). In response to the request, content server504 h provides a media page (610), for example a web page, forpresentation by the web browser or media client application.

The web page presents one or more live streaming selections, includingthe live stream provided from spot replacement server 504 b in operation602. When a user selects a live stream, the corresponding client system502 a-502 c requests the selected live stream (612), which is sent toclient system 502 a-502 c (614) by content server 504 h throughdistribution connection 506. Client system 502 a-502 c then beginspresenting the live stream.

When a client system 502 a-502 c begins presenting the live streamprovided by spot replacement server 504 b, client system 502 a-502 creceives an identifier of the stream (a streamID), either from the livestream or derived, for example, from the web page serving the stream.Client system 502 a-502 c also creates a globally unique identifier(GUID) that identifies the particular client system 502 a-502 c. Clientsystem 502 a-502 c then sends auditing and advertising system 508 aconnect status message through status connection 510 a-510 c. Theconnect status message includes the streamID and GUID (616). Clientsystem 502 a-502 c then periodically or aperiodically sends a presentingstatus message (which includes streamID and GUID) (618) until clientsystem 502 a-502 c disconnects from the stream (some presenting messagesare shown with dotted lines to promote clarity of the figure). Clientsystem 502 a-502 c then sends a disconnect status message with thestreamID and the GUID (620). If client system 502 a-502 c attaches to adifferent stream it would then send status messages with the newstreamID.

Master control center console 504 c controls when spot replacementserver 504 b provides programming content from programming contentsource 504 a and when spot replacement server 504 b switches to anadvertising content source. Master control center console 504 cindicates to spot replacement system 504 b the timing of whenadvertising content should be sent (620), for example, indicating thatan advertising break is coming up. This indication may be in the formof, for example, a relay closure, or an extensible mark-up language(XML) feed sent by a web page on master control center console 504 c.

When spot replacement system 504 b receives the indication, spotreplacement server 504 b requests that auditing and advertising system508 determine what advertising content should be sent (622). Auditingand advertising system 508 then selects particular advertising contentto be sent (624). To do so, auditing and advertising system 508 maystore business rules regarding various advertising campaigns and executesoftware that evaluates those business rules to determine particularadvertising content. The business rules regarding an advertisingcampaign define the parameters under which associated advertising mediashould be presented, such as the time of day during which theadvertising media should be presented (for example, at night ormid-afternoon), the percentage of the population to whom the advertisingmedia should be presented, the frequency with which the advertisingmedia should be presented, and/or the geographic location(s) of theusers to whom the advertising media should be presented. The selectionof advertising content also may be informed by consulting log files orschedules to determine the length of the ad break that is available tobe filled.

Advertising and auditing system 508 then indicates the selectedadvertising content to spot replacement system 504 b (626). Spotreplacement system 504 b then switches between the programming contentsource 504 a to a source of the selected advertising content at thescheduled time, for example, when an advertising break occurs (628).This results in the advertising content being sent to encoder 504 g(630), which encodes the advertising content (632) and provides theencoded advertising content to content server 504 h (634). Contentserver 504 h sends the encoded advertising content to client system 502a-502 c (636).

Spot replacement system 504 b also sends auditing and advertising system508 an audit message through auditable event connection 512 (638). Theaudit message includes an identifier of the advertising content(advertising ID). The audit message also may include an identifier ofthe stream (streamID) in which the advertising content is located.

In addition, the audit message may include the absolute time at whichthe advertising content is starting. For example, the audit message mayinclude the absolute time in an implementation in which the auditmessages are not sent at substantially the same time that theadvertising content is sent. Even in implementations in which the auditmessage is sent at substantially the same time, the audit message mayinclude the absolute time.

Auditing and advertising system 508 then performs an audit of theadvertising content (640). For example, auditing and advertising system508 creates a table that tracks how many GUIDs (and, hence, uniqueclient systems) are connected to any given stream, such as the streamprovided by spot replacement serer 504 b. When an audit message isreceived by auditing and advertising system 508 from spot replacementserver 504 b, the number of connected GUIDs are tallied and recorded forthe advertising content identified in the auditing message.

Referring to FIG. 7A, auditing and advertising system 508 creates atable such as table 700 to track the number of unique client systemspresenting a stream at any given time. Table 700 includes a column 702containing the streamIDs of different streams and a column 704 thatincludes the corresponding number of unique client systems currentlypresenting the stream. For example, the stream with streamID 101 has1000 unique client systems currently presenting the stream.

Referring to FIG. 7B, auditing and advertising system 508 can use table700 to create table 750 as audit messages are received from spotreplacement server 504 b. As auditing and advertising system 508receives an audit message, auditing and advertising system 508 consultstable 700 to determine the number of unique users currently connected tothe streamID indicated in the audit message. Auditing and advertisingsystem 508 then records an advertising ID 752 from the audit message,and a date 754 and a time 756 that the audit message was received (or asindicated by the audit message, depending on the implementation), andthe number of unique client systems connected to the stream 758 fromtable 700. For example, because 9:58 am is taken to be the current time,as indicated in the last row of Table 750, the number of currentlyconnected unique users 704 from Table 700 (that is, 1000) has beeninserted into Table 750 as the number of unique users connected 758 at9:58 am.

Referring to FIG. 8, a system 800 illustrates one on-demand streamingimplementation that includes client systems 802 a-802 c connected to acontent distribution system 804 through a distribution connection 806.An auditing and advertising system 808 is connected to client systems802 a-802 c through one or more status connections 810 a-810 c and, andto distribution system 804 through an auditable event connection 812.

System 800 is similar to system 500 and the elements of system 800 areanalogous to similarly labeled elements in system 500. One difference isthat the stream provided to client system 802 a-802 c is not a livebroadcast stream, but rather is pre-encoded and pre-stored, for example,on a content server 804 h. Thus, any of client systems 802 a-802 c mayaccess and present the stream from the beginning at any given time.

Referring to FIG. 9, a process 900 illustrates one method of usingsystem 800. In process 900, client system 802 a may request a media pagefrom content server 804 h (902) and content server 804 h returns themedia page (904). The media page provides a selection of one or moreon-demand streams. When a user selects an on-demand stream using clientsystem 802 a (906), content server 804 h sends the stream to clientsystem 802 a for presentation.

The on-demand stream may include programming content (908) andadvertising content (910). While not shown in FIG. 9, in someimplementations, when a user selects an on-demand stream, content server804 h may communicate with advertising and auditing system 808 to selectthe particular advertising content provided as part of the on-demandstream.

When client system 802 a begins presenting the on-demand stream, clientsystem 802 a sends a connect status message to auditing and advertisingsystem 808 (912). The connect status message includes a streamID and aGUID. Client system 802 a then sends a presenting status messageperiodically or aperiodically (914) until the on-demand stream iscompleted, or until the user stops the presentation of the on-demandstream. When the on-demand stream is completed or the user stops thepresentation of the on-demand stream, client system 802 a sends adisconnect status message to auditing and advertising system 808 (916).

Content server 804 h sends one or more audit messages to auditing andadvertising system 808 (918). The audit messages include the relativetiming(s) of the advertising content in the on-demand stream,identification(s) of the advertising content, and a streamID of theon-demand stream.

Auditing and advertising system 808 performs an audit of the advertisingcontent on a periodic or aperiodic basis (920). For example, auditingand advertising system 808 may determine the number of unique clientsystems 802 a-802 c that present particular advertising content eachday, week, or month. Based on the status messages received from a clientsystem, auditing and advertising system 808 can determine how long theclient system presented a particular on-demand stream. Given thecorresponding audit message for the on-demand stream, auditing andadvertising system 808 can determine the relative timing(s) of theadvertising content in the particular on-demand stream. As a result,auditing and advertising system 808 can determine whether the on-demandstream was presented long enough so that particular advertising contentwas presented by a client system. For instance, if particularadvertising content occurs one minute into an on-demand stream and aclient system presented on-demand stream for five minutes, then auditingand advertising system 808 can mark the particular advertising contentas having been presented by the client system. Auditing and advertisingsystem 808 can then tally the number of unique client systems 802 a-802c that presented particular advertising content.

The techniques described above are not limited to any particularhardware or software configuration. Rather, they may be implementedusing hardware, software, firmware or a combination of them. The methodsand processes described may be implemented as computer programs that areexecuted on programmable computers comprising at least one processor andat least one data storage system. The programs may be implemented in ahigh-level programming language and may also be implemented in assemblyor other lower level languages, if desired.

Any such program will typically be stored on a computer-usable storagemedium or device (for example, CD-Rom, RAM, or magnetic disk). When readinto the processor of the computer and executed, the instructions of theprogram cause the programmable computer to carry out the variousoperations described above.

A number of implementations have been described. Nevertheless, it willbe understood that various modifications may be made. For example, thecontent distribution system may be a cable television distributionsystem, the distribution connection may be a cable television network,and the client system may be a personal video recorder, such as a Tivo®system made by Tivo Inc. of Alviso, Calif. A personal video recorderrecords the content delivered by the cable television network forcontemporaneous or later viewing by a user. A personal video recordermay derive an identification of the content from the cable televisionstream or from other information accessed, for example, by communicatingacross the Internet or another network (e.g., the Public SwitchedTelephone Network (PSTN)). For example, Zap2it of Santa Monica, Calif.provides television guide information that may be accessed through theInternet and used by a personal video recorder. The personal videorecorder may generate status messages that include an identifier of thecontent presented and may include the absolute or relative times atwhich the content is presented. The status messages then may be sent toan auditing system by communicating across the Internet or othernetwork.

Also, while the foregoing has described the use of the HTTP protocol andHTML, other standard or proprietary protocols may be used. In addition,while the auditing system 308 has been illustrated as a separate system,the auditing system 308 may be incorporated into other components suchas the client systems 302 or the content distribution system 304.Moreover, while a scheduler (media control center console 504 c) hasbeen illustrated as part of the content distribution system 504, thescheduler may be a separate entity, and may be incorporated into othercomponents such as the auditing and advertising system 508. Furthermore,elements of different implementations may be combined, deleted, added,supplemented or modified to yield further implementations. In addition,actions or communications do not necessarily need to occur in the orderin which they are depicted. Accordingly, other implementations arewithin the scope of the following claims.

What is claimed is:
 1. A computer-implemented method for monitoring thedisplay of electronic content on client devices: receiving, by a serverprocessor, a request for a media page from a user device; sending, bythe server processor, the media page to the user device, the media pageincluding a selection of one or more streams of dynamic content;receiving, by a server processor, a request for a stream of dynamiccontent from the user device; transmitting, by the server processor, thestream of dynamic content to the user device, the stream of dynamiccontent including a first programming content and a first electroniccontent; receiving, at the server processor, indication from the userdevice that the first electronic content has transpired on a display ofthe user device; parsing, by the server processor, the receivedindication to determine presentation time information, the presentationtime information indicating one or more times the first electroniccontent presented at the display of the client device; and based on theparsing of the received indication, transmitting, by the serverprocessor, the presentation time information to a receiving entityassociated with the first electronic content.
 2. Thecomputer-implemented method of claim 1, further including: determiningthe presentation time information based on receiving the indication fromthe user device.
 3. The computer-implemented method of claim 2, furtherincluding: determining the presentation time information based on timeinformation included in the received indication from the user device. 4.The computer-implemented method of claim 1, wherein an audit messageassociated with the first electronic content is received by the serverprocessor from a content distribution system.
 5. Thecomputer-implemented method of claim 1, wherein an audit messageassociated with the first electronic content is received from ascheduler.
 6. The computer-implemented method of claim 1, furthercomprising: determining a number of user devices receiving one or moreinstances of the stream of dynamic content.
 7. The computer-implementedmethod of claim 1, wherein: the stream of dynamic content includeson-demand streaming content, and the presentation time informationindicates one or more times at which a presentation of the on-demandstreaming content occurs at the user device.
 8. A system comprising: amemory device that stores instructions; and one or more processors thatexecute the instructions to perform a series of steps, the series ofsteps including: receiving, by a server processor, a request for a mediapage from a user device; sending, by the server processor, the mediapage to the user device, the media page including a selection of one ormore streams of dynamic content; receiving, by a server processor, arequest for a stream of dynamic content from the user device;transmitting, by the server processor, the stream of dynamic content tothe user device, the stream of dynamic content including a firstprogramming content and a first electronic content; receiving, at theserver processor, indication from the user device that the firstelectronic content has transpired on a display of the user device;parsing, by the server processor, the received indication to determinepresentation time information, the presentation time informationindicating one or more times the first electronic content presented atthe display of the client device; and based on the parsing of thereceived indication, transmitting, by the server processor, thepresentation time information to a receiving entity associated with thefirst electronic content.
 9. The system of claim 8, further including:determining the presentation time information based on receiving theindication from the user device.
 10. The system of claim 9, furtherincluding: determining the presentation time information based on timeinformation included in the received indication from the user device.11. The system of claim 8, wherein an audit message associated with thefirst electronic content is received by the server processor from acontent distribution system.
 12. The system of claim 8, wherein an auditmessage associated with the first electronic content is received from ascheduler.
 13. The system of claim 8, further comprising: determining anumber of user devices receiving one or more instances of the stream ofdynamic content.
 14. The system of claim 8, wherein: the stream ofdynamic content includes on-demand streaming content, and thepresentation time information indicates one or more times at which apresentation of the on-demand streaming content occurs at the userdevice.
 15. A non-transitory computer readable medium storinginstructions that, when executed by at least one processor, cause the atleast one processor to perform a series of steps, the series of stepsincluding: receiving, by a server processor, a request for a media pagefrom a user device; sending, by the server processor, the media page tothe user device, the media page including a selection of one or morestreams of dynamic content; receiving, by a server processor, a requestfor a stream of dynamic content from the user device; transmitting, bythe server processor, the stream of dynamic content to the user device,the stream of dynamic content including a first programming content anda first electronic content; receiving, at the server processor,indication from the user device that the first electronic content hastranspired on a display of the user device; parsing, by the serverprocessor, the received indication to determine presentation timeinformation, the presentation time information indicating one or moretimes the first electronic content presented at the display of theclient device; and based on the parsing of the received indication,transmitting, by the server processor, the presentation time informationto a receiving entity associated with the first electronic content. 16.The non-transitory computer readable medium of claim 15, furtherincluding: determining the presentation time information based onreceiving the indication from the user device.
 17. The non-transitorycomputer readable medium of claim 16, further including: determining thepresentation time information based on time information included in thereceived indication from the user device.
 18. The non-transitorycomputer readable medium of claim 15, wherein an audit messageassociated with the first electronic content is received by the serverprocessor from a content distribution system.
 19. The non-transitorycomputer readable medium of claim 15, wherein an audit messageassociated with the first electronic content is received from ascheduler.
 20. The non-transitory computer readable medium of claim 15,wherein: the stream of dynamic content includes on-demand streamingcontent, and the presentation time information indicates one or moretimes at which a presentation of the on-demand streaming content occursat the user device.